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The present invention relates generally to the field 
of imaging, and more particularly, to an adaptive and 
learning process for selecting settings in an imaging 
device. 



Nearly all modern imaging devices have multiple 
settings which are controlled electronically. Purely 
mechanical controls in imaging devices have become 
extremely rare. Electronic settings controls in imaging 
devices provide much greater ease of use and improved 
image quality for the amateur user, since they can be 
preprogrammed for a number of different environments. 
For example, most modern cameras, whether film or digital 
cameras, have several modes with preprogrammed settings, 
such as for low light nighttime photography or for high 
speed sports photography. In each mode settings for 
exposure time, f-stop, etc are predetermined and 
programmed into the camera. These preprogrammed modes 
allow the user to take reasonably good pictures in a 
number of general types of environments. 

In addition, many imaging devices allow the user to 
manually adjust one or more of the settings in order to 
deviate from the preprogrammed modes and settings. This 

HP: 10992521-1 



Background of the Invention 



-2- 

allows the more experienced user to increase the quality 
of the images when none of the preprogrammed modes are 
well suited to the environment. In fact, with the 
unlimited variation in environment and the small number 
5 of preprogrammed modes in most imaging devices, it is 

unlikely that a preprogrammed mode will provide the best 
possible image quality. Furthermore, user's tastes in 
images vary widely, making it difficult or impossible to 
program settings which will most please every user. 

10 

As digital imaging devices have become increasingly 
popular, the problem is exacerbated, since digital 
cameras typically have more settings to adjust than film 
cameras. For example, digital imaging devices have a 

15 white balance setting, which is used to prevent color 
shifts, ensuring that white objects actually appear 
white. Thus, even though the number of preprogrammed 
modes may remain the same in digital cameras as in film 
cameras, the number of settings to be programmed for each 

20 mode is greater. This further decreases the likelihood 
that the preprogrammed settings will provide the 
preferred image for every user in a given environment. 

Digital cameras are well known in the art and 
25 various components thereof are described in US Patent 

4,131,919, US Patent 4,420,773, and US Patent 4,541,010, 
all of which are hereby incorporated by reference for all 
that they disclose. 

30 Digital cameras require a high level of interaction 

with the user. There are a large number of settings that 
may be adjusted to optimize and personalize the resulting 
image quality. However, the process of adjusting the 
settings can be cumbersome and confusing to the user. 
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The typical user may not understand many of the settings 
and how they affect the picture. In addition, the user 
usually needs settings optimized for only a few 
situations, and may be satisfied with the preprogrammed 
modes in other environments. 

A need therefore exists for a method of adjusting 
settings in an imaging device which solves some or all of 
the above problems. 



Summary 

To assist in achieving the aforementioned needs, the 
15 inventors have devised an adaptive and learning setting 
selection method for imaging devices. This causes an 
imaging device to adapt to user preference over time. As 
the user adjusts settings in the imaging device, the new 
settings are combined with previous settings as points in 
20 settings space, forming a cluster of points. The camera 
then finds the optimal point in the cluster and uses the 
point to set camera options. Each mode in the camera 
thus develops a cluster of points in settings space, so 
that the optimal point changes as user preferences 
25 change. In addition, new modes may be formed in the 

camera when user settings differ to a large degree from 
settings in any predefined mode. 

The invention may comprise a method of configuring 
30 settings in an imaging device. The method includes 

retrieving the previous state of a plurality of settings 
in the imaging device. The new state of the settings in 
the imaging device are determined. The new state is 
combined with the previous state to form an optimal state 
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of the settings. The imaging device is then configured 
with the settings according to the optimal state. 

The invention may also comprise an electronic 
5 imaging device having an imaging system and computer 
readable program code. The computer readable program 
code includes code for retrieving at least one previous 
state of a plurality of settings in the imaging device, 
for determining a new state of the plurality of settings, 
10 and code for combining the at least one previous state 
with the new state to form an optimal state. The 
computer readable program code also includes code for 
configuring the settings in the imaging device according 
to the optimal state. 

15 

The invention may also comprise a digital imaging 
apparatus having means for selecting a mode, means for 
adjusting a plurality of settings, and means for tracking 
user preferences in the plurality of settings. 

20 



Brief Description of the Drawing 

Illustrative and presently preferred embodiments of 
25 the invention are shown in the drawing, in which: 

FIG. 1 is a perspective front view of a digital 
camera; 

FIG. 2 is a perspective rear view of the digital 
camera of FIG. 1; 
30 FIG. 3 is a diagram illustrating the hierarchy of 

modes and settings in an imaging device; 

FIG. 4 is a flow chart illustrating a basic adaptive 
and learning setting selection process in an imaging 
device ; 
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FIG. 5 is a graph of a two-dimensional settings 
space having multiple clusters made up of settings 
points; 

FIG. 6 is a flow chart illustrating the process of 
5 locating an optimal point representing a cluster; 

FIG . 7 is a flow chart illustrating the creation and 
maintenance of settings clusters in the case that the 
optimal point of a cluster is at the cluster' s arithmetic 
mean; 

10 FIG. 8 is a flow chart illustrating a preferred 

adaptive and learning setting selection process in an 
imaging device which employs a cluster of previous 
settings to calculate optimal settings; 

FIG. 9 is a flow chart illustrating an alternate 

15 preferred adaptive and learning setting selection process 
in an imaging device in which multiple previous settings 
are accumulated to calculate optimal settings; and 

FIG. 10 is a flow chart illustrating an adaptive and 
learning settings selection process in an imaging device 

20 which combines the previous optimal settings with the 

current settings to calculate the new optimal settings. 



Description of the Preferred Embodiment 

25 

The drawing and description, in general, disclose a 
method of configuring settings in an imaging device. The 
method includes retrieving the previous state of a 
plurality of settings in the imaging device. The new 
30 state of the settings in the imaging device are 

determined. The new state is combined with the previous 
state to form an optimal state of the settings. The 
imaging device is then configured with the settings 
according to the optimal state. 
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The drawing and description also disclose an 
electronic imaging device having an imaging system and 
computer readable program code. The computer readable 
program code includes code for retrieving at least one 
5 previous state of a plurality of settings in the imaging 
device, for determining a new state of the plurality of 
settings, and code for combining the at least one 
previous state with the new state to form an optimal 
state. The computer readable program code also includes 
10 code for configuring the settings in the imaging device 
according to the optimal state. 

The drawing and description also disclose a digital 
imaging apparatus having means for selecting a mode, 
15 means for adjusting a plurality of settings, and means 
for tracking user preferences in the plurality of 
settings . 

An adaptive and learning setting selection process 
20 may be included in any imaging device having at least one 
user adjustable setting, such as exposure time or 
aperture. The adaptive and learning setting selection 
process enables the imaging device to track or follow 
user preferences for these settings. Each time the user 
25 makes adjustments to the settings in the imaging device, 
the new values are accumulated so that the imaging device 
can learn and adapt to the user preferences. The imaging 
device then combines new user adjusted settings with 
accumulated previous settings to calculate optimal 
30 settings for the user. The imaging device is then 
configured according to the optimal settings. 

For imaging devices having multiple modes, the 
accumulated values are stored according to the current 
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mode. For example, an imaging device may have a sports 
mode and a normal mode, where the sports mode has a lower 
exposure time than the normal mode in order to capture 
high speed activities without motion blur. User adjusted 
5 settings are associated with a particular mode, so that 
each mode tracks user preferences for a certain 
environment . 

The adaptive and learning setting selection process 

10 in an imaging device provides great benefits such as 

simplifying use and improving image quality for a given 
user. With the adaptive and learning setting selection 
process, the imaging device learns as the user adjusts 
settings. The imaging device thus becomes personalized, 

15 creating images which correspond much more closely to 
user preferences than those created with static, 
preprogrammed settings. The adaptive and learning 
setting selection process can also create new modes on 
the imaging device when the user adjusted settings differ 

20 greatly from settings in existing modes. For example, an 
imaging device may be preprogrammed with a sports mode 
for high speed imaging. If the user changes settings to 
create images of winter sports activities having a 
brilliant snowy background, the adaptive and learning 

25 setting selection process may create a new mode to 

capture high speed images that are not overexposed and 
washed out. 

The adaptive and learning setting selection process 
30 also greatly simplifies adjustment of settings in the 

imaging device. The settings in the imaging device are 
defaulted to previous optimal settings based on user 
preferences. Therefore, the user will typically have 
fewer changes to make in a new environment than if the 
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settings were preprogrammed to a factory default. 

The adaptive and learning setting selection process 
may also simplify settings selection by presenting a 
5 group of sample images, each created with different 

possible settings. The user may then simply select the 
preferred image, rather than blindly adjusting settings 
manually. Typical users do not fully understand the 
settings and how they affect resulting images in a given 
10 imaging device without a great deal of practice. By 
presenting sample images, the adaptive and learning 
setting selection process allows the user to adjust 
settings much more easily. 

15 Typical types of imaging devices which may benefit 

from the adaptive and learning setting selection process 
include digital cameras 10 (FIG. 1) . Digital cameras 10 
are well-known in the art and are analogous to ordinary 
film-type cameras, except that the film is replaced with 

20 a photoelectric detector (e.g., a charge-coupled device 
(CCD) ) . The photoelectric detector converts the light 
received by the camera into electronic signals, which may 
be digitized and stored as digital image data. For 
example, the resulting digital image data may be stored 

25 in an electronic memory system, such as random access 

memory (RAM) , or may be stored on a magnetic or optical 
disk of the type commonly used to store digital data. 

Digital cameras 10 offer considerable advantages 
30 over conventional film-type cameras in that the digital 
image data may be stored, processed, and/or reproduced 
with ease. The relative ease of handling and processing 
the digital image data produced by digital cameras allows 
users to readily enlarge, reduce, crop, or otherwise 
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modify the digital image data to create any of a wide 
range of photographic effects and styles, as well as to 
easily capture the image of a document and convert text 
in the image to a text file. 

5 

Before describing the adaptive and learning setting 
selection process in more detail, an exemplary digital 
camera 10 which may employ the adaptive and learning 
setting selection process will be described. However, it 
10 is important to note that the adaptive and learning 
setting selection process is not limited to any 
particular type of imaging device. For example, the 
imaging device may also comprise a scanner. 

15 A digital camera 10 (FIGS. 1 and 2) includes an 

optical imaging assembly to convert image light to 
electronic image data, a storage device to store the 
image data, and a control system, all contained in a 
housing 14. The control system provides a user 

20 interface, controls the optical imaging assembly, and 

processes and formats the image data. The control system 
also implements the adaptive and learning setting 
selection process by accepting user adjusted settings, 
accumulating previous settings, calculating optimal 

25 settings and configuring the optical imaging assembly 
according to the optimal settings. A lens 20 in the 
optical imaging assembly is located in the housing 14 to 
allow light to enter the digital camera 10. Control 
buttons, such as a shutter control button 12 and 

30 navigation buttons 24, 26, 30, and 32, are provided on 
the outside of the housing 14. The digital camera 10 
preferably includes an illumination system such as a 
flash 16 mounted on the outside of the housing 14. A 
display device 22 is also located on the outside of the 
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housing 14. The digital camera 10 also includes a power 
source such as a battery. Each of the foregoing systems 
and devices will now be described in detail. 



5 The housing 14 of the digital camera 10 comprises a 

generally rectangularly shaped structure sized to receive 
the various internal components of the camera 10. The 
housing 14 is sized to receive the optical imaging 
assembly, which includes a lens 20 and an electrical 

10 photodetector . The lens 20 is preferably telecentric or 
near telecentric. The photodetector detects image light 
focused thereon by the lens 20 and comprises a CCD, 
although other devices may be used. A typical CCD 
comprises an array of individual cells or "pixels," each 

15 of which collects or builds-up an electrical charge in 

response to exposure to light. Since the quantity of the 
accumulated electrical charge in any given cell or pixel 
is related to the intensity and duration of the light 
exposure, a CCD may be used to detect light and dark 

20 spots on an image focused thereon. 

The term "image light" as used herein refers to the 
light that is focused onto the surface of the detector 
array by the lens 20. The image light may be converted 

25 into digital signals in essentially three steps. First, 
each pixel in the CCD detector converts the light it 
receives into an electric charge. Second, the charges 
from the pixels are converted into analog voltages by an 
analog amplifier. Finally, the analog voltages are 

30 digitized by an analog-to-digital (A/D) converter. The 
digital data then may be processed and/or stored as 
desired. 

The storage device in the digital camera 10 stores 
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the image data collected by the optical imaging assembly. 
The storage device preferably comprises a random access 
memory (RAM) , or may comprise a magnetic, optical, or 
other solid state storage medium. 

5 

The control system in the digital camera 10 provides 
a user interface, controls the optical imaging assembly, 
and processes and formats the image data, either before 
or after storage in the storage device. The control 

10 system also implements the adaptive and learning setting 
selection process. The control system preferably 
comprises a microprocessor and associated memory. 
Alternatively, the control system may comprise a hard- 
coded device such as an application specific integrated 

15 circuit (ASIC) . 

The display device 22 in the digital camera 10 is a 
liquid crystal display (LCD) or any other suitable 
display device. The digital camera 10 also includes 

20 other components, such- as a battery system. However, 

since digital cameras are well-known in the art and could 
be easily provided by persons having ordinary skill in 
the art after having become familiar with the teachings 
of the present invention, the various systems and devices 

25 of a digital camera 10 that may be utilized in one 

preferred embodiment of the present invention will not be 
described in further detail herein. 

During operation of the digital camera 10, the 
30 camera 10 is oriented with the lens 20 directed at a 
subject. The mode is selected and the settings are 
adjusted as desired by the user. The mode and settings 
are adjusted with the navigation buttons 24, 26, 30, and 
32 or by any other suitable means, such as with a 
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computer attached to the digital camera 10. The adaptive 
and learning setting selection process then calculates 
optimal settings and configures the digital camera 10 
with the optimal settings, as will be described in 
5 greater detail hereinafter. (The optimal settings may be 
overridden by the user if desired.) The subject may be 
monitored either through a viewf inder (not shown) or on 
the display panel 22. When the digital camera 10 is 
: properly oriented, the shutter control button 12 is 
10 pressed. The photodetector converts the image light 
directed thereon by the lens 20 into electrical image 
data, which are stored in the storage device. The 
control system then processes the image data and displays 
the captured image on the display panel 22. 

15 

Before continuing with the description of the 
adaptive and learning setting selection process, the 
1 relationship between modes and settings will be defined. 
, The mode is a configurable state of the imaging device 
20 which is chosen according to the subject characteristics, 
.such as brightness and speed of movement. Settings are 
used to control each adjustable parameters of the imaging 
, device, such as aperture size and exposure time. For 
- each mode, the settings are configured with values which 
25 ; produce an acceptable image given the subject 

characteristics. The hierarchy of modes (e.g., 40 and 
42) and settings (e.g., 44-50, 52-56) in the digital 
camera 10 is illustrated in FIG. 3. Each mode 40 and 42, 
such as low light and sports, respectively, contains a 
30 group of settings 44-50 and 52-56. Exemplary settings in 
the digital camera 10 include exposure time 44 and 52, 
aperture 4 6 and 54, and ISO speed 50 and 56. For 
example, if the digital camera 10 is in the low light 
mode 40 shown in FIG. 3, the exposure time setting 44 is 
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H second, the aperture setting 46 is f2.8, and the ISO 
speed setting 50 is 400. If the digital camera 10 is in 
the sports mode 42, the exposure time setting 52 is 1/800 
second, the aperture setting 54 is fll, and the ISO speed 
5 setting 56 is 100. 

Settings may be adjusted in several ways according 
to the adaptive and learning setting selection process. 
Settings may be entered by the user directly on the 
10 digital camera 10, e.g., by pressing the control buttons 
24-32. Settings may also be entered on a computer which 
transmits the settings values to the digital camera 10. 

Alternatively, settings may be adjusted by 
15 presenting sample images to the user, one of which is 

chosen as having the preferred image characteristics. In 
this case, a set of sample images is prepared, preferably 
all having the same subject matter. Each of the sample 
images is prepared to illustrate the effects of different 
20 settings values. For example, a set of three sample 

images may be prepared having three different exposure 
times. The user would then choose one of the three 
sample images, and the exposure setting on the digital 
camera 10 would be set to the exposure setting used to 
25 prepare the chosen sample image. The sample images may 
be displayed in any suitable manner, such as 
simultaneously or one after the other. The sample images 
may be displayed on the display panel 22, on a remote 
computer screen, or on a printed page. 

30 

Referring now to FIG. 4, an overview of the adaptive 
and learning setting selection process in operation in 
the digital camera 10 will be given. As a mode is 
selected 70, a group of previous settings are retrieved 
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72 for that mode. Optimal settings are calculated 7 4 to 
represent the group of previous settings. The digital 
camera 10 is then configured 76 according to the 
retrieved previous optimal settings. If the user 
5 manually adjusts 82 some of the settings, the new 

settings are combined 84 with the previous settings to 
and new optimal settings are calculated based on the 
combined new and previous settings. The digital camera 
10 is then reconfigured 76 with the new optimal settings. 

10 Thus, each time the user manually adjusts 82 settings on 
the digital camera 10, the camera 10 is learning the 
preferences of the user. Over time, user adjusted 
settings are combined or averaged to focus in on user 
preferences. The user may take a picture 80 at any time 

15 after the camera is configured 76 with the optimal 

settings, whether new manually adjusted settings have 
been entered 82 or not. 

Note that one or more settings may remain automatic 
20 in the digital camera 10, or all may be manually set. 

For example, the exposure time setting is often automatic 
in imaging devices, subject to an internal light meter. 
In this case, it may be desirable to exclude the 
automatic settings from the adaptive and learning setting 
25 selection process. In other words, automatic settings 
would not be included in the calculation for optimal 
settings. However, under some conditions, such as in a 
portrait studio, the lighting is controlled and the user 
may wish to manually control all settings in a digital 
30 camera 10, including exposure time. In this case, all 
settings would be included in the adaptive and learning 
setting selection process. 

Note also that the digital camera 10 may be provided 
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with an entirely manual mode, in which the adaptive and 
learning setting selection process is overridden and 
manually adjusted settings are directly used to configure 
the digital camera 10, rather than calculating and using 
5 optimal settings. 

Three preferred embodiments of the adaptive and 
learning setting selection process will now be discussed. 
In the first, multiple previous states are accumulated in 

10 the digital camera 10 (see FIGS. 5-8), and the digital 

camera 10 is configured with optimal settings as soon as 
they are calculated. In the second, multiple previous 
states are accumulated in the digital camera 10 (see 
FIGS. 5-8), and the digital camera 10 is configured with 

15 optimal settings after a mode change or the digital 

camera 10 is again turned on. In the third, only the 
most recent previous state is kept (see FIG. 9) . 

The first preferred embodiment of the adaptive and 
20 learning setting selection process will now be described. 
In this embodiment, the digital camera 10 accumulates 
previous settings as points in a settings space. The 
settings space is a multidimensional space in which each 
dimension in the settings space is defined by one of the 
25 settings in the digital camera 10. Points in settings 
space are preferably grouped in clusters according to 
different modes on the digital camera 10. 

An exemplary settings space 100 is illustrated in 
30 FIG. 5. In this example, the digital camera 10 has two 
settings which are included in the adaptive and learning 
setting selection process. Each different state of the 
two settings in the digital camera 10 may be represented 
as a point in a two dimensional settings space 100. The 
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settings space 100 is illustrated in a graph in which the 
first axis 102 represents the first setting and the 
second axis 104 represents the second setting. (For 
example, the two settings could be exposure time and 
5 aperture setting.) 

The settings space 100 is bounded on four sides 106, 
108, 110, and 112. The position of the boundary is 
determined by the acceptable range of settings in the 

10 digital camera 10. The top boundary 106 and bottom 
boundary 112 are established by the upper and lower 
limits, respectively, of the first setting. The left 
boundary 108 and right boundary 110 are established by 
the upper and lower limits, respectively, of the second 

15 setting. 

In this example, the digital camera 10 has two 
modes, each having a cluster 114 and 120 of points (e.g., 
124 and 140) . The first cluster 114 of points is 

20 associated with the first mode, and the second cluster 
120 of points is associated with the second mode. That 
is, the points in the first cluster 114 were stored while 
the digital camera 10 was in the first mode, with only 
small manual adjustments were made to the settings. The 

25 points in the second cluster 120 were stored while the 

digital camera 10 was in the second mode, with only small 
manual adjustments made to the settings. The digital 
camera 10 is preferably preprogrammed with a settings 
point for each mode by the manufacturer. This allows the 

30 digital camera 10 to be configured with suitable initial 
settings in each mode, before the adaptive and learning 
setting selection process personalizes the digital camera 
10 according to user preferences. 
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The optimal point of a cluster is used to find the 
best representation of a users preferences. As the user 
manually adjusts settings, adding settings points to a 
cluster, the cluster will become increasingly dense with 
5 points and the optimal point in the cluster will become 
an increasingly good representation of the users 
preferences. The optimal point of a cluster is 
preferably the arithmetic mean of the cluster, as this 
calculation can be done rapidly by a simple processor. 
10 Alternatively, other algorithms for calculating an 

optimal point to represent a cluster may be used. For 
example, the median may be used, which is less sensitive 
to outlying settings points in a cluster than the mean, 
although it is not as simple to calculate. 

15 

The process for finding the optimal point of a 
cluster as the arithmetic mean is illustrated in the flow 
chart of FIG. 6. The arithmetic mean is the average of 
the settings points in the cluster. Each coordinate of 

20 each settings point in the cluster is averaged, and the 
resulting averaged coordinates combine to form the 
location of the optimal point. This process may be 
accomplished by first setting 220 a variable i to 1 . The 
i'th coordinate of each point in the cluster is retrieved 

25 222 and summed 224. The sum is divided 226 by the number 
of points in the cluster to produce the i'th coordinate 
of the mean point. If points in the cluster have more 
than i coordinates 230, then i is incremented 232, and 
the process is repeated starting by retrieving 222 the 

30 new i'th coordinates. Once all the coordinates of the 
mean point are calculated, they are grouped 234 to form 
the location of the optimal point. 

For example, referring to FIG. 5, the first cluster 
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114 consists of seven settings points, point 124 at 
(15,13), point 126 at (14,10), point 128 at (17,11), 
point 130 at (19,11), point 132 at (17,9), point 134 at 
(20,9), and point 136 at (17,7). Note that the values 
5 and units shown here are arbitrary and are normally based 
on the actual settings in a digital camera 10. They may 
be represented as an 8-bit digital number from 0 to 255, 
or as a set of acceptable settings values such as f-stop 
numbers, or in any other suitable manner. To calculate 

10 the location of the optimal point 116 in the first 

cluster 114, the first coordinates of each settings point 
in the cluster are summed, then divided by the number of 
points in the cluster: (15 + 14 + 17 + 19 + 17 + 20 + 17) 
/ 7 = 17. The second coordinates of each settings point 

15 in the cluster are then summed and divided by the number 
of points in the cluster: (13 +10+11+11+9+9+7) 
/ 7 = 10. The resulting coordinates are then grouped as 
the location of the optimal point 116: (17,10). Note 
that the coordinates of the optimal point may need to be 

20 rounded to the nearest acceptable settings value for the 
digital camera 10. 

Similarly, the second cluster 120 consists of six 
settings points, point 140 at (3,8), point 142 at (4,5), 

25 point 144 at (5,4), point 146 at (4,3), point 150 at 

(2,2), and point 152 at (6,2). The first coordinates of 
each settings point in the cluster are summed, then 
divided by the number of points in the cluster: (3 + 4 + 
5+4+2+6) / 6 = 4. The second coordinates of each 

30 settings point in the cluster are then summed and divided 
by the number of points in the cluster: (8+5+4+3+ 
2+2) / 6 = 4. The resulting coordinates are then 
grouped as the location of the optimal point 122: (4,4). 
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The settings space is not limited to the two 
dimensional example described herein. In practice, a 
multidimensional settings space includes one dimension 
for each setting on the digital camera 10 which is to be 
5 included in the adaptive and learning setting selection 
process . 

Points (e.g., 124 and 140) in settings space 100 may 
be clustered, or arranged into clusters, in any suitable 

10 fashion. A number of suitable mathematically intensive 
but effective clustering algorithms are well known. The 
preferred method, and perhaps the simplest, is to 
preprogram an initial point in each cluster as mentioned 
above. Thereafter, a new point is included in a cluster 

15 if it is within a predetermined threshold distance 156 of 
the optimal point in a cluster. For example, the point 
126 is within the threshold distance 156 from the optimal 
point 116 of the first cluster 114, but outside the 
threshold distance 156 from the optimal point 122 of the 

20 second cluster 120. Therefore, the point 126 will be 
stored with the first cluster 114. 

The point 154 is outside the threshold distance of 
both clusters 114 and 120, so a new cluster and mode will 
25 be created containing the point 154. Note that this 

means that if the digital camera 10 is placed into a . 
certain mode and the settings are drastically manually 
adjusted, the mode may be changed or a new mode can be 
created based on the new settings. 

30 

If a new settings point is within the threshold 
distance of the optimal point of more than one cluster, 
it is included in the closest cluster. 
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Note also that the boundary of a cluster (e.g., 
114), defined by the threshold distance 156 from the 
optimal point (e.g., 116), may fall in part outside of 
the settings space 100 if the optimal point 116 is close 
5 enough to one or more boundaries (e.g., 106) of the 

settings space. For example, a portion of the boundary 
of the first cluster 114 includes a region 118 outside 
the settings space 100. However, since no settings 
points outside the settings space 100 can be entered on 
10 the digital camera 10, no points will fall in regions 118 
inside clusters but outside the settings space. 

Referring now to FIG. 7, this preferred clustering 
process will be summarized, for the embodiment in which 

15 the optimal point is at the arithmetic mean of a cluster. 
A new settings point is first obtained 170 when the user 
manually adjusts settings in the digital camera 10. The 
distance between the new settings point and the mean 
point in each cluster is then calculated 172. The 

20 algorithm used to calculate distance depends upon the 
number of dimensions in settings space, and the chosen 
geometry of the settings space. Suitable algorithms for 
calculating distance in different types of 

multidimensional space are well known, such as the square 
25 root of the sum of the squares to calculate distance in a 
Cartesian coordinate system (((x2-xl) A 2 + (y2-yl)^2 + 
(Z2-Z1) A 2) A *s) . 

The cluster with the nearest mean point to the new 
30 settings point is selected 174, and the distance to this 
nearest mean point is compared 17 6 with the predetermined 
threshold distance. If the new settings point is within 
the threshold distance, the new settings point is stored 
180 with the cluster, and the new arithmetic mean of the 
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cluster is calculated and stored 182. If the distance 
between the new settings point and the nearest mean point 
is greater than the threshold distance, a new cluster is 
created 184 containing the new settings point, and the 
5 arithmetic mean of the new cluster is stored 186. (In 

this case, with only one point, the arithmetic mean is at 
the same location as the new settings point.) 

Calculating and storing the arithmetic mean for a 
10 cluster when adding a new settings point speeds up later 
operations by avoiding the need to recalculate the mean 
over and over when changing modes on the digital camera 
10 or when adding later settings points. 

15 The number of previous settings states, or points, 

which are accumulated in the preferred embodiment may be 
limited by the available memory in the digital camera 10 
or may be limited to a predetermined number to simplify 
clustering calculations . 

20 

The adaptive and learning setting selection process 
for the preferred embodiment in which multiple settings 
points are accumulated in clusters will now be summarized 
(see FIG. 8). As the user selects a mode 200, the 

25 cluster of settings points associated with that mode is 
identified 202. The optimal point representing the 
cluster is retrieved 204 if it was previously stored, 
otherwise it is calculated. The digital camera 10 is 
configured 206 with the settings represented by the 

30 optimal point. The user may take a picture 208 with the 
optimal settings at this point. If the user elects to 
manually adjust settings, a new point in settings space 
is formed 210 based upon the manually adjusted settings. 
The nearest cluster to the new point is identified or 
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created, as described above with respect to FIG. 7, and 
the new point is stored 212 with the cluster. If the 
cluster is not the same as the beginning cluster of the 
second step 202, the mode on the digital camera 10 is 
5 changed. If the cluster is a new one, the user may be 
prompted to enter a name for a new mode associated with 
the new cluster. The optimal point representing the 
updated cluster having the new point is calculated 214, 
and the digital camera 10 is again configured 206 with 
10 settings represented by the optimal point. 

The second preferred embodiment of the adaptive and 
learning setting selection process will now be discussed 
(see FIG. 10) . In this embodiment, multiple settings 

15 points are accumulated, from which optimal settings are 

calculated. The digital camera 10 utilizing the adaptive 
and learning setting selection process is not immediately 
configured with the optimal settings when they are 
calculated. Rather, when a user manually adjusts 

20 setting's in the digital camera 10 the optimal settings 
are calculated, but the digital camera 10 remains 
configured with the manual settings. The digital camera 
10 is not configured with the new optimal settings until 
default settings are needed, such as when the mode is 

25 changed or when the digital camera is turned off and on 
again . 



In this embodiment, manually adjusted settings are 
also not automatically stored. The digital camera 10 has 
30 three accumulation modes which determine whether new 

manual settings are stored or accumulated. In the first, 
new manually adjusted settings are automatically stored. 
In the second, new manually adjusted settings are 
automatically discarded. In the third, the digital 



HP: 10992521-1 



t t 



-23- 

camera 10 prompts the user to indicate whether to store 
or discard the new manually adjusted settings. 

This process is illustrated in FIG . 10. The user 
5 first selects 216 a mode, or turns on the digital camera 
10 making it default to a mode. The stored settings 
associated with the mode are retrieved 218, and the 
optimum settings representing the stored settings are 
calculated 220. The digital camera 10 is configured 222 

10 with the optimal settings, and the user may take 224 a 
picture. If the user manually adjusts 226 one or more 
settings, the digital camera 10 remains configured with 
the new manually adjusted settings, and the user may take 
228 a picture. Taking 228 the picture triggers the 

15 digital camera 10 to continue with the settings storage 

process, so that the user can continue to manually adjust 
settings without storing settings before the adjustment 
process is complete. 

20 The accumulation mode is checked 230 to determine 

whether to store the new manually adjusted settings. If 
the digital camera 10 is in Discard mode, the manually 
adjusted settings are discarded 232. In other words, the 
manually adjusted settings are not stored, even though 

25 the digital camera 10 remains configured with them until 
the mode is changed, the digital camera 10 is turned off, 
or new manually adjusted settings are entered. If the 
digital camera 10 is in Add mode, the new manually 
adjusted settings are stored 234 with previous settings. 

30 If the digital camera 10 is in Prompt mode, the user is 
prompted 236 to indicate whether to store or discard the 
new settings. If the user indicates 238 that settings 
should be stored, the new manually adjusted settings are 
stored 234 with previous settings. If not, the new 
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manually adjusted settings are discarded 232. 

The third preferred embodiment of the adaptive and 
learning setting selection process, in which only the 
5 most recent previous state is kept, will now be discussed 
(see FIG. 10) . In this embodiment, the digital camera 10 
stores only one default settings state for each mode. 
The default settings may be thought of as a point in 
settings space, as described above, or simply as a state 

10 of the settings. In either case, the calculations and 
results are the same. The digital camera 10 is 
configured with the default settings when turned on or 
when a mode is selected. New settings are combined with 
the default settings and the resulting settings are 

15 stored over the default settings. As a result, the 
default settings move over time to follow the user 
preferences. Each time new settings are to be combined 
with the existing default settings, new default settings 
are calculated which lie somewhere between the existing 

20 default settings and the new settings. For example, the 
existing default and new settings may be averaged, or the 
new default settings may lie between the existing default 
and new settings at a predetermined percentage of the 
distance between the two, such as at 30% of the distance 

25 from the existing default settings to the new settings. 

This process is illustrated in the flow chart of 
FIG. 10. The user first selects 240 a mode, and the 
existing default settings state is retrieved 242. The 
30 digital camera 10 is configured 244 with the settings in 
the default settings state, and the user may take a 
picture 246 with the default settings. If the user 
adjusts the settings, the new manually adjusted settings 
are combined 250 with the existing default settings to 
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form a new default settings state. The new default 
settings state is stored 252 over the previous default 
settings state. The digital camera 10 may be 
reconfigured 244 immediately with settings in the new 
5 default settings state. Alternatively, the digital 

camera 10 may be configured with the settings in the new 
default settings state after the mode is changed or the 
next time the digital camera 10 is turned on. This 
embodiment is especially well suited for imaging devices 
10 having a strong mode of preference rather than several 
distinct modes. 

Aspects of an adaptive and learning setting 
selection process are also described in U.S. Patent 

15 application entitled "ADAPTIVE AND LEARNING SETTING 
SELECTION PROCESS WITH SELECTABLE LEARNING MODES FOR 
IMAGING DEVICE" (Attorney Docket No. 10007731-1) of 
Daniel M. Esquibel, et al., filed concurrently herewith 
and which is incorporated herein by reference for all 

20 that it discloses. 

While illustrative and presently preferred 
embodiments of the invention have been described in 
detail herein, it is to be understood that the inventive 
25 concepts may be otherwise variously embodied and 

employed, and that the appended claims are intended to be 
construed to include such variations, except as limited 
by the prior art. 
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